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Abstract 

We prove that the fidehty between the quantum state governed by a 
continuous time stochastic master equation driven by a Wiener process 
and its associated quantum-filter state is a sub-martingale. This result is a 
generalization to non-pure quantum states where fidelity does not coincide 
in general with a simple Frobenius inner product. This result implies 
the stability of such filtering process but does not necessarily ensure the 
asymptotic convergence of such quantum-filters. 



1 Introduction 

The quantum filtering theory provides a foundation of statistical inference in- 
spired in e.g. quantum optical systems. These systems are described by continuous- 
time quantum stochastic differential equations. These stochastic master equa- 
tions include the measurement back-action on the quantum-state. The quantum 
filtering theory has been developed by Davies in the 1960s [lUl E] and in its 
modern form by Bclavkin in the 1980s [HO [3]. 

To these stochastic master equations are attached so-called quantum filters 
providing, from the real-time measurements, estimations of the quantum states. 
Robustness and convergence of such estimation process has been investigated 
in many papers. For example, sufficient convergence conditions, related to ob- 
servability issues, are given in [5D] and [TO]. As far as we know, general and 
verifiable necessary and sufficient convergence conditions do not exist yet. For 
links between quantum filtering and observers design on cones see [6]. In this 
paper, we generalize a stability result for pure states (see, e.g., [TJ) to arbitrary 
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mixed quantum states. More precisely, we prove that the fidehty between the 
quantum state (that could be a mixed state) and its associated quantum-filter 
state is a sub-martingale: this means that in average, the estimated state tends 
to be closer to the system state. This does not imply its asymptotic convergence 
for large times. To prove such convergence, more specific analysis depending on 
the precise structure of the Hamiltonian, Lindbladian and measurement opera- 
tors defining the system model is required. This paper can also be seen as an 
extension to continuous-time evolution of [T5] . 

This paper is organized as follows. In section [5J we introduce the non linear 
stochastic master equations driven by Wiener processes and providing the evo- 
lutions of the quantum state and of the quantum-filter state and we state the 
main result fThcorem l2.ip . Scction|3]is devoted to the proof of this result: firstly 
we consider an approximation via stochastic master equations driven by Pois- 
son processes (diffusion approximation); secondly, we prove the sub-martingale 
property via a time discretization. In final section, we suggest some possible 
extensions of this work. 

2 Main result 

Wc will consider quantum systems of finite dimensions 1 < < oo. The state 
space of such a system is given by the set of density matrices 

2?:={peC^x^| p^p\ Tr(p) = l, p > 0}. 

Formally the evolution of the real state p G I? is described by the following 
stochastic master equation (cf. [51 [71 [^) 

dpt = -^[H, pt] dt + C{pt)dt + A(pt) dWt , (1) 

where 

• the notation [A, B] refers to AB — BA; 

• H = H'^ is a Hermitian operator which describes the action of external 
forces on the system ; 

• dWt is the Wiener process which is the following innovation 

dWt = dyt - Tr ((i + i^) pt) dt , (2) 

where yt is a continuous semi- martingale with quadratic variation (y, y)t = 
t (which is the observation process obtained from the system) and L is 
an arbitrary matrix which determines the measurement process (typically 
the coupling to the probe field for quantum optic systems) ; 

• the super-operator C is the Lindblad operator, 

C{p) :=-'-{L^L,p} + LpL^, 
where the notation {A, B} refers to AB + BA; 
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• the super-operator A is defined by 

A{p) Lp + pL^ - Tr ((L + L'^)p) p. 

All the developments remain valid when H and L are deterministic time- varying 
matrices. For clarity sake, we do not recall below such possible time dependence. 

The evolution of the quantum filter of state pt G V is described by the fol- 
lowing stochastic master equation which depends on the time-continuous mea- 
surement ut depending on the true quantum state pt via ([2]) (see, e.g., [1]): 



dpt = -j-[H, pt]dt + C{pt) dt + K{pt){dyt - Tr {{L + L^)pt) dt). (3) 
Replacing dyt by its value given in we obtain 

dpt=~j. [H, pt]dt + C{pt)dt + K{pt) dWt 

+ A(pO (Tr {{L + L^)p,) - Tr {{L + Lt)p,) ), 



\dt. 



A usual measurement of the difference between two quantum states p and 
(T, is given by the fidelity, a real number between and 1. More precisely, the 
fidelity between p and a in I? is given by (see [16l chapter 9] for more details) 



F{p,a)=T^'\J^pa^p\. (4) 



Here F{p^ a) — \ means p = a, and F{p^ cr) = means that the support of p and 
a are orthogonal. F[p, a) coincides with their inner product Tr (per) when at 
least one of the states p or cr is pure (i.e., orthogonal projector of rank one). It 
is well known that the stochastic master equations ^ and ^ leave the domain 
2? positively invariant. This results form the fact that, using Ito rules, we have 

fl-^dt-^L'^Ldt+Ldyt'^ Pt (l-^dt-^L^ Ldt+Ldyt^ 

Pt+dt = 77 -77 T 7 -TT 

Tr( (l--^dt-iLt_Ldt+Ldytj Pt (l-^dt-^L^ Ldt+Ldytj J 

and 

_ (l-^dt-^L^Ldt+Ldyt) pt (l-^dt-^L^ Ldt+LdytV 
Pt+dt = f, — N _ / ,H — 7TT (6) 



Tr 



(^(l-'^dt-^Li- Ldt+Ldyt^ Pt (l-'^dt-^L'> Ldt+Ldyt^^^ 



where dyt = Tr ((i + Lt) pt) dt + dWt- 

These alternative formulations imply then directly that, as soon as, po and 
Po belong to V, pt and pt remain in 2? for alH > 0. Therefore the expression of 
fidelity given by ^ is well defined. 

We are now in position to state the main result of this paper. 
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Theorem 2.1. Consider the Markov processes {pt,pt) satisfying the stochastic 
master Equations ([1]) and ([3]) respectively with po, po in V. Then the fidehty 
F{pt, pt), defined in Equation dU, is a submartingale, i.e. E {F{pt, pt)\{ps,Ps)) > 
F{ps, Ps), for all t > s. 

We recall that the above theorem generalize the results of [T^] to arbitrary 
purity of the real states and quantum filter. If po is pure, then pt remains pure 
for all t > 0. In this case, F{pt, pt) coincides with Tr (ptPt)- It is proved in [T^ 
that this Frobcnius inner product is a sub-martingale for any initial value of pt'- 
^E(Tr(ptpt)) > 0. The main idea of the proof in [T2] consists in using Ito's 
formula to reduce the theorem to showing that E (Tr (dptpt + ptdpt + dptdpt)) > 
0, and then using the shift invariance of the operator L in the dynamics ([1]) 
and ([3]) and choosing an appropriate value. 

In the absence of any information on the purity of the real states and the 
quantum filter, the fidelity is given by (jlj, and the application of Ito's formula for 
the above expression becomes much more involved. In particular, the calculation 
of the cross derivatives was so complicated that it became hopeless to proceed 
this way. As the proof presented in the next section shows, we had to choose 
an undirect way to approach the theorem which allowed us to avoid the heavy 
calculations based on second order derivative of F. 



3 Proof of Theorem [23] 

We proceed in two steps. 

• In the first step, we describe briefly how we obtain the stochastic master 
equations ([T]) and ^ as the limits of the stochastic master equations 
with Poisson processes using the diffusive limits inspired from the physical 
homodyne detection model [21 [23] . 

• In the second step, we show that the fidelity between the real state and 
the quantum filter which are the solutions of stochastic master equations 
with Poisson processes is a submartingale. 



Step 1. Take a > a large real number and consider the evolution of the 
quantum state p" described by the following stochastic master equation derived 
from homodyne detection scheme (see section 6.4 of |8] or |2], [23]) for more 
physical details): 

dpt - - j-W, pt]dt ~ \A^{pt)dt + T^{pt)dN, (7) 
-\A^„ipt)dt + T^^ipt)dN2, 

where the super-operators Tq, is defined as follows 

{L + a)piL^+a) 
'"^^'■^ TriiL + a)p{Lf + a)) ^' 
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and the super-operator Aq, is defined by 

A„(p) := (L + a)p + p{L'' + a) - Tr ((L + + 2a)p) p. 

The super-operators A_q, and T_q, are just obtained with replacing a by 
—a in the expressions given in above. 

The two processes dNi and dN2 are defined by 

dTVi := 7V,V,, - and dN2 := Nf+,, ^ Nf 

where N-^ and iV^ are two Poisson processes. dNi and (iiV2 take value 1 by prob- 
abilities iTr ((Lt -I- a){L + a)pf) dt and iTr ((L^ - a)(L - a)pt°') dt, respectively, 
and take value by the complementary probabilities. 

Similarly, the following stochastic master equation describes the infinitesimal 
evolution of associated quantum filter of state pf (see |Tj ) : 

dpt" = - i[H,pt'']dt - iA„(pt")di + T^{pt")dm (8) 
-iA_„(pt")dt + T_„(pt")d7V2. 

The following diffusive limit is obtained by the central limit theorem when 
a tends to -l-oo for the semi-martingale processes applied to dNq, q = 1,2, (see 
[15] or [H] for more details) 

dN,^{'-^)dt+^/{^)dW,, (9) 

where the notation (A) refers to the mean value of A. Here 
(dTVi) = iTr ((it + a){L + a)pf) dt and (diVz) = iTr ((L^ - a){L - a)pf) dt 
and dWi and dW2 are two independent Wiener processes and the convergence 
in © is in law. 

The stochastic master Equations ([T|) and (O are obtained by replacing the 
processes dNg for q £ {1,2} by their limits given in ^ in the master equa- 
tions (O and ([8]) and taking the limit when a goes to -l-oo and keeping only the 
lowest ordered terms in a^^. Such a result is usually called diffusion approxi- 
mation (see e.g [H). 

Notice that dW appearing in the stochastic master equations ([1]) and ([3]) is 
given in terms of its independent constituents by 

dW = ^{dWi+dW2), 

and is thus itself a standard Wiener process. 

The following theorem from |17j justifies the diffusion approximation de- 
scribed above. 

Theorem 3.1 (Pellegrini-Petruccione [13 )• The solutions of the stochastic 
master Equations ([7]) and (|8]) converge in law, when a — > +oo, to the solu- 
tions of the stochastic master Equations ([T]) and ([3|), respectively. 
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Step 2. We now prove that the fidehty between two arbitrary solutions of 
the stochastic master Equations ([7]) and ([8]) is a submartingale. 



Proposition 3.1. Consider the Markov process (p", fP) which satisfy the stochas- 
tic master Equations ([7]) and ([5]). Then the fidelity defined in Equation Q is 
a submartingale, i.e., for all t > s, wc have 

E{F{pt,f^)\{p':,p^))>F{p':,p^). 



Proof. We consider approximations of the time-continuous Markov processes ([7]) 
and dH) by discrete-time Markov processes and ^fc: 

^--^ = TV(M.,,.<) i...- ^^ij^:;i^y (10) 

where 

• A: G {0, • • • , n} for a fixed large n; 



• initial condition = and = 



/ifc is a random variable taking values /i £ {0, 1, 2} with probability ^ 
Tr (Af^CfeM^) ; 

The operators Mq, Mi and M2 are defined as follows 



Mo 1 - i(Lt -f a){L + a)e„ - i(Lt - a){L - a)e„ - iiJe„; 

Afi := (L + a) 
and 

M2 := (L-a)y^; 

with e„ = — . 

In the following lemma, we show that ^„ and ^„ correspond to the Euler- 
Maruyama time discretization. Since ([7]) and (|8]) depend smoothly on pf and 
p^, ^„ and ^„ converge in law towards and when n 1— > +00. 

Lemma 3.1. T/ie processes ^fc anrf correspond up to second order terms in 
e„, to the Euler-Maruyama discretization scheme of ([7|) and ([5]) on [s,t\. 
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Proof, we regard the three following possible cases which arrive in according 
to the different values of ■ In each case, we show that and for k G 
{0, • • • ,n} are the numerical solutions of the dynamics ([7]) and dH]) respectively, 
with the following partition s < s + e„ < • • • < s + (n — l)e„ < t, where the 
uniform step length e„ is 

Case 1. We first consider the case where = which arrives with proba- 
bility Po,fe = Tr (^MoCfcMj) . Note that 

Mo^kM^o =^k -1{{L^ + a){L + a),^k} e„ 
-i{(it_«)(L_«),^,}e„ 

Therefore 

Tr (MoCfcA/j) = 1 - iTr ((it + a)(L + a)^^) e„ 

- iTr ((it _ a){L ~ a)^^) e„ + 0((e„)') 

and 

(Tr (Moea4) y'^l+'-Tr ((it + + a)^k) £„+ 
iTr ((it - a){L - e„ + 

Therefore, we find the following dynamics 

Ck+i-^k^\{{L^ + a){L + a),^k}en 
-i{(it-a)(i-a),6}e„ 
+ iTr((it + a)(i + a)efe) Cfc e„ 
+ iTr ((it - a)(i - a)^) 6 + 0(efj. 

This can also be written as follows 

- a « - iA,(a) e„ - iA_„(a) e„ + 0(4)- (H) 

Obviously, this dynamics in the first order of e„ is equivalent to the dynamics 
of the numerical solution of the stochastic master Equation ^ with the partition 
s<s + en<---<s + {n — l)e„ < t, when 

A^l+(fc+i),„ - N^+ke„ = and A^,^(fc+i),„ - N^+ke„ = 0, 
which arrives with probability 
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(l-iTr((L + a)(Lt + a)a) £„)••• 
•••(l-iTr((L-a)(Lt-a)Cfc) e„). 

This probability, in the first order of e„ is equal to Tr (^Mo^kM^^ . 

Case 2. The second case corresponds to = 1 which arrives with proba- 
bihty Tr (^Mi^^kMl^ . We find the following dynamics 

^Z^+l - Ti-((L+a)a(Lt+„)) - I + aj a + 

We observe that the numerical solution of the stochastic master Equation ([7]) 
follows also the same dynamics when 

iV,V(fe+i),„ - iVi+,,^ = 1 and iV,%(,+i),,^ - 7V,^,,^ = 0, 
which arrives with probability 

(iTr((L + Q)(Lt+a)a-) e„) (l - ^Tr ((L - _ ^,.) 

This is equal to Tr (^Mi^kMl^ , in the first order of e„. 

Case 3. Now we consider the last case fi^ ~ 2 which arrives with probability 
Tr (MzCfeM^) . Therefore, we have 

> {L~a)^k{L^ -a) _ (C \ \ C 

— Tr((L-Q)Cfc(Lt-a)) " ^ -qIC/c j + ^fe. 

Which can also be written by the stochastic master equation ([7]) with taking 
as the numerical solution and 

^.V(fe+i).„ - Ns+ke„ = and N^+^k+i)e„ - N^s+ke^ = 1, 
which arrives with probability 

(1 - iTr ((L + a){L^ + a) e„) (^Tr ((i - a){L^ - a) 6) ew) . 

Where in the first order of e„, this probability is equal to Tr ^A/2^fcM2^ . 

Remark that, if we neglect the terms in the order of e^, The probability of 
- iVi+,,„ = 1 and^7V2^(,^,)^^ - TV,^^^^ = 1 is negligible. Now it 

is clear that and similarly are respectively the numerical solutions of the 
stochastic master Equations ([7]) and ([5]) obtained by Euler-Maruyama method. 
As the right hand side of the stochastic master Equations ([7]) and ([5]) are smooth 
with respect to p and p, we can use the result of [131 Theorem 1] to conclude 
the convergence in law of ^„ and ^„ to and for large n. 

□ 
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Now we notice that 

mIMo + M/Mi + mIM2 = I + 0{el) A, 
Take Mr :~ {\/A)~^Mr for r = 0, 1, 2 which satisfy necessarily 

Mo'' Mo + Ml Ml + M2 = I. (12) 
Now we define the fohowing Markov processes Xk and Xk by 

Xk+l 

and 

Xfc+i 

where 

• A: G {0, • • • , n} for a fixed large n; 

• Xo= Ps and xo = P?; 

• /ifc is a random variable taking values fi € {0, 1, 2} with probability P^^^ = 
Tr (M^XkMl) . 

Clearly Xk and Xfc can also be seen as the numerical solutions of the stochas- 
tic master Equations ([7]) and (|H]), since {\/A)^^ = I — ©(e^J, therefore in the 
first order of e„, the solutions ^fc and are equal to Xk and Xk, respectively. 
But, the advantage of using Xk and Xk instead of ^fc and is that the operators 
Mr are Kraus operators since they satisfy Equality ([T2|) . Thus we can apply 
Theorem 1 in jl8| . which proves that F{xkTXk) is a sub-martingale. 

Theorem 3.2 ([13). Consider the Markov chain {xk,Xk) satisfying ([T3l) and ([T4| 
Then F{xk,Xk) is a sub-martingale: ¥.{F{xk+i,Xk+i)\{Xk,Xk)) > F{xk,Xk)- 

Thus we have 

E (F(x„, X„) I xo, xo) > Fixo, xo) = Fip^, p^) 

Therefore by Lemma iB.l) we have necessarily 

EiFipf,pfM,K))>Fip'^,p^), 

for all i > s, since we have (convergence in law) pf ~ lim„ ^ocXn, pf = 

lim„_^oo Xn> Xo = Ps and xo = P?- 

□ 

Wc now apply Theorem 13.11 and we use the fact that the function F is 
bounded by one and continuous with respect to p and p: 

EiFipupt)\{ps,Ps))>F{ps,Ps), 

for alH > s, which ends the proof of Theorem 12. II 



Tr 



{M^,XkM,J) ' 



(13) 
(14) 
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4 Numerical Test 



In this section, we test the resuh of Theorem l2.1l through numerical simulations. 
Considering the two- level system of [21] , we take the following Hamiltonian and 
measurement operators: 



The simulations of figure [T] illustrates the fidelity for 500 random trajectories 
starting at 

po=(| l) and po=(^ I 

In particular, we note that both initial states are mixed ones. As it can be seen 
the average fidelity is monotonically increasing. Here, the fidelity converges 
to one indicating the convergence of the filter towards the physical state. An 
interesting direction here is to characterize the situations where this convergence 
is ensured. 

Here in order to simulate the Equations ^ and ([3]), we have considered 
the alternative formulations and ([B]) and the resulting discretization scheme 
(/c G N and time step < < 1) 

_ MkP(kdt)M\ ^ _ MkP(kdt)-Ml 

where Mk = I- ^dt- ^L^ Ldt+Ldy(^kdt) and dy(^kdt) = Tr {{L + L^) pj^.^^)) dt+ 
dW(^kdt)- For each k, the Wiener increment dW(^kdt) is a centered Gaussian ran- 
dom variable of standard deviation \/dt. The major interest of such discretiza- 
tion is to guaranty that, if po, Po G then pk and pk also remain in V for any 
fc > 0. 



5 Concluding remarks 

The fact that the fidelity between the real quantum state and the quantum- 
filter state increases in average remains valid for more general stochastic master 
equations where other Lindbald terms are added to C{p) appearing in ([T]). In 
this case the dynamics ([T]) and ([3]) become 

?n' m m 

dpt = -UH.Pt] dt + J2^'Mdt + J2cMdt + Y,Mpt)dwt 

U—l /i — 1 /J,— 1 

m' rn 

dpt = -i[H, pt] dt + J2 KiPt) dt + J2 ^^^(Pt) dt 

V=l /J,— 1 

m ^ 

+ ^A^(pO(rfyr 



- Tr{{L^ + Ll)pt)dt 
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Figure 1: The average fidelity between the Markov processes p and p, over 500 
realizations, time t from to T = 3 with discretization time step dt = 10^^. 



where dW^^ are independent Wiener processes, 

■= -^{LlLf,, p} + Lf,pLl, 

Kip) ■= -\{L'J L'^,p} + L'^pL'J , 

and A^(p) := L^p + pLt - Tr ((L^ + L^p) p. 

Here m,m' > 1, and {L'^,)i<u<m' and [L^)i<^<:„i are arbitrary operators. 
The special case considered here corresponds to to = 1 and to' = 1 with Li = L 
and L'^ — 0. The formulations analogue to (O and ^ read then 

(I - dNh)pt{l - dMl) + Erii L'.ptL'Jdt 

Pt+dt — 7 ; ; — 7 

Tr ((I - dMt)pt{l - dMl) + E"Li KptL'Jdt) 

and 

^ _ (I - dMt)pt (I - dMl) + Erii KptL'Jdt 

Pt+dt — 7 ; ; — 

Tr ((I - dMt)pt{^ - dMl) + E"Li L'JtL'Jdtj 

where, denoting dyi' ^ Tr ((L^ + Ll)pt) dt + dW^ , 

dMt ='-^dt+'-J2 L'jL'Jt + \ J2 L,^L,dt - ^t^dy^- 

For this general case, the proof of Theorem 12.11 should follow the same lines: 
first step still relics on Theorem 13. 11 second step relies now on [THl Theorem 2]. 

Acknowledgements. The authors thank C. Pellegrini, L. Zambotti and M. 
Gubinclli for stimulating discussions and useful suggestions during the prepara- 
tion of the paper. 



11 



References 



A. Barchiclli. Direct and heterodyne detection and other apphcations of 
quantum stochastic calculus to quantum optics. Quantum Optics: Journal 
of the European Optical Society Part B, 2:423, 1990. 

A. Barchielli and M. Gregoratti. Quantum trajectories and measurements 
in continuous time: the diffusive case. Springer Vcrlag. 2009. 

V.P. Belavkin. Quantum stochastic calculus and quantum nonlinear filter- 
ing. Journal of Multivariate analysis, 42(2):171-201, 1992. 

VP Belavkin. Quantum filtering of Markov signals with white quantum 
noise. Quantum communications and measurement, page 381, 1995. 

VP Belavkin. Towards the theory of control in observable quantum systems. 
Arxiv preprint ^quant-ph/0408003, 2004. 

S. Bonnabel, A. Astolfi, and R. Sepulchre. Contraction and observer design 
on cones. In to appear in 50th IEEE Conference on Decision and Control, 
pages 768-780, 2011. 

L. Bouten, M. Guta, and H. Maassen. Stochastic Schrodinger equations. 
Journal of Physics A: Mathematical and Ceneral, 37:3189, 2004. 

H.P. Breuer and F. Petruccione. The theory of open quantum systems. 
Oxford University Press, USA, 2002. 

G. Gostantini. Diffusion approximation for a class of transport processes 
with physical reflection boundary conditions. The Annals of Probability, 
19(3):1071-1101, 1991. 

EB Davies. Quantum stochastic processes. Communications in Mathemat- 
ical Physics, 15(4):277-304, 1969. 

E.B. Davies. Quantum theory of open systems, volume 96. IMA, 1976. 

L. Diosi, T. Konrad, A. Scherer, and J. Audretsch. Goupled Ito equations of 
continuous quantum state measurement and estimation. Journal of Physics 
A: Mathematical and General, 39:L575, 2006. 

D.J. Higham and P.E. Kloeden. Numerical methods for nonlinear stochastic 
differential equations with jumps. Numerische Mathematik, 101(1):101~ 
119, 2005. 

J. Jacod and A.N. Shiryaev. Limit theorems for stochastic processes, volume 
2003. Springer Berlin, 1987. 

J. A. Lane. The central limit theorem for the Poisson shot-noise process. 
Journal of Applied Probability, 21(2):287-301, 1984. 



12 



[16] M. Nielsen and I. Chuang. Quantum Computation, 1999. 

[17] C. Pellegrini and F. Petruccione. Diffusion approximation of stoehastic 
master equations with jumps. Journal of Mathematical Physics, 50:122101, 
2009. 

[18] P. Rouchon. Fidelity is a sub-martingale for any quantum filter. 
To appear in IEEE Transaction on Automatic Control (Arxiv preprint 
\arXiv:1005.3TT9\) . 2011. 

[19] R. Van Handel. Filtering, stability, and robustness. PhD thesis, California 
Institute of Technology, 2006. 

[20] R. van Handel. The stability of quantum Markov filters. Infin. Dimens. 
Anal. Quantum Probab. Relat. Top., 12:153-172, 2009. 

[21] R. van Handel, J.K. Stockton, and H. Mabuehi. Feedback control of quan- 
tum state reduction. IEEE Trans. Automat. Control, 50. 

[22] R. Van Handel, J.K. Stockton, and H. Mabuehi. Feedback control of quan- 
tum state reduction. Automatic Control, IEEE Transactions on, 50(6):768- 
780, 2005. 

[23] HM Wiseman and GJ Milburn. Interpretation of quantum jump and 
diffusion processes illustrated on the Bloch sphere. Physical Review A, 
47(3):1652-1666, 1993. 



13 



